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Method and Apparatus for Biometric Control of Display Indicator 
Technical Field 

This invention relates generally to control of display indicators and more 
particularly to biometric control of display indicators such as on-screen 
cursors. 

Background 

Display indicators such as on-screen cursors are well known and understood 
in the art. Such indicators serve to highlight an on-screen element or 
otherwise identify a screen area where additional actions are intended. Such 
display indicators are usually manipulated by a mouse, touchpad, arrow 
keys, trackball and the like. Such devices also usually have one or more 
control surfaces that can be asserted to thereby provide a selection signal 
that corresponds to the present display indicator position (such functionality 
is usually referred to as a "click" and often includes both a so-called "left 
click" and a "right click"). 

Unfortunately, not all potential users are able to usefully (or easily) 
manipulate such display indicator devices. For example, some potential 
users have physical infirmities (including partially or wholly missing or less 
than fully functional digits or limbs) that preclude full use of such devices. To 
meet this need, biometrics have been suggested as a way to facilitate user 
control of a display indicator. While existing biometric solutions have 
provided a satisfactory interface for some users, however, problems remain. 
For example, many biometric solutions are not suitable for all such potential 
users. And even when conceptually suitable, many such solutions are unduly 
complicatejd and too expensive for many potential users (for example, many 
biometric solutions seeking to provide X-Y control of a display indicator 
requires at least four separate biometric sensors). Beyond this, many prior 
art biometric solutions lack portability and further often require a significant 
amount of user training. 
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Consequently, a need still exists for a biometric solution to display indicator 
control that avoids at least some of these problems. 

5 Brief Description of the Drawings 

This need and others are substantially met through provision of the method 
and apparatus for biometric control of a display indicator as disclosed herein. 
These and other benefits will become more evident upon making a thorough 
10 review and study of the following detailed description, particularly when 
reviewed in conjunction with the drawings, wherein: 

FIG. 1 comprises a flow diagram depicting an embodiment configured in 
accordance with the invention; 

15 

FIG. 2 comprises a view of a human arm having biometric sensors attached 
thereto; 

FIG. 3 comprises a block diagram depiction of various embodiments 
20 configured in accordance with the invention; 

FIG. 4 comprises a schematic depiction of a voltage shifting and scaling unit 
as configured in accordance with the invention; 

25 FIG. 5 comprises a detailed flow diagram depicting an embodiment 
configured in accordance with the invention; 

FIGS. 6 through 9 comprise views of a display indicator on a display; 

30 FIG. 10 comprises a detailed flow diagram depicting an embodiment 
configured in accordance with the invention; 

FIG. 1 1 comprises a view of a display indicator on a display; and 
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FIG. 12 comprises a block diagram depiction of various embodiments 
configured in accordance with the invention. 

Detailed Description 

Pursuant to the teachings herein, an apparatus is provided having a first and 
second biometric signal input. These signals are provided to a signal 
translator that translates these signals to provide angular direction of 
movement information and magnitude of movement information for a display 
indicator. Pursuant to one embodiment, a first biometric signal, such as an 
electromyogram signal, is sensed and utilized to establish the angle of 
directional movement information for an on-screen cursor. A second 
biometric signal, again such as an electromyogram signal, is sensed and 
utilized to establish movement of the on-screen cursor in a previously 
determined direction. Such an apparatus and method can be implemented 
with only two biometric sensors. By relying upon electromyogram signals, 
the sensors can be placed on any activatable muscle (even if that muscle is 
not fully capable). Because so few sensors are required and because the 
sensors can be placed on any at least somewhat workable muscle, this 
approach can be used for virtually all potential users. 

Referring now to FIG. 1, in one embodiment 10 electromyogram signals are 
sensed 11. When a first electromyogram signal is sensed 12, the angle of 
movement for a display indicator is established 13. When a second 
25 electromyogram signal is sensed 14, that display indicator can be moved 15. 
Additional details and alternative embodiments will be provided below. 

Eectromyogram signals are a well understood phenomenon of muscle 
tissue. When a given muscle contracts, a small corresponding electrical 
30 signal occurs. Such a signal can be detected by an electromyogram sensor 
as well understood in the art. Such sensors typically provide an output 
voltage that corresponds to the strength of the musculature electrical signal. 
Electromyogram sensors will provide signals of varying maximum 
magnitudes when placed in contact with virtually any muscle. Such sensors 
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are also simple to use; they are relatively small and can be held in place with 
simple adhesive devices such as double sided tape. In FIG. 2 a first 
electromyogram sensor 21 A is shown as positioned to sense a shoulder 
muscle 22 and a second electromyogram sensor 21 B is shown as positioned 
to sense a hand muscle 23. Such positioning will be presumed for the 
remainder of this detailed description, but it should be understood that 
virtually any muscle could be used, including muscles on the face, torso, and 
legs. Appropriate muscles as are available to a given potential user should 
be selected on an individual basis. 

An overall system 30 as depicted in FIG. 3 includes a processor 32 that 
functions in this embodiment as a signal translator and that couples to the 
two electromyogram sensors 21 A and 21 B. The processor 32 can be, for 
example, an HC1 1 family device as offered by Motorola, Inc. The 
electromyogram sensors 21 A and 21 B couple to analog to digital inputs of 
the processor 32 through voltage shifting and scaling units 31 A and 31 B 
(additional detailed regarding these units will be provided below). If desired, 
the processor 32 can couple to a local output device such as a display 33. In 
addition, and again if desired, a user input mechanism 34 can also couple to 
the processor 32 (for example, the user input 34 can include a reset button, 
one or more translation sensitivity controls, and so forth). The processor 32 
also couples to a radio frequency transmitter 35 (this coupling can be 
effected, for example, using an RS232 interface and protocol) . 

So configured, the processor 32 can receive electromyogram signals from 
the two electromyogram sensors 21 A and 21 B. These signals can be sensed 
and translated as described earlier to establish angle of movement 
information and magnitude of movement information for a display indicator 
such as an on-screen cursor. The latter information can then be transmitted 
by the transmitter 35. 

A receiver 36 receives the information as transmitted by the transmitter 35. 
The receiver 36 couples to a computer 37 (this coupling can be effected, for 
example, using a keyboard/mouse serial interface and protocol). The 
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computer 37 can be any appropriate computational platform but most 
typically will be a standard personal computer. The computer 37 couples to 
and drives a display 38 such as a cathode ray tube display or other display 
platform such as a flat panel display. 

So configured, the receiver 36 can receive the display indicator movement 
information as transmitted by the transmitter 35 and provide this information 
to the computer 37 to effect movement of a display indicator such as an on- 
screen cursor on the display 38. 
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The above described embodiment provides for a wireless transmission of 

O information to the computer 37. If desired, of course, a wired path 39 could 
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jp, be utilized instead. Also as described, the wireless path comprised a radio 

frequency based technology. If desired, of course, other wireless 
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H With reference to FIG. 4 the shifting and scaling unit 31 as generally 

![:! mentioned above will now be described in more detail. A pair of substantially 

H 20 identical parallel configured resistors 42 and 43 couple between the inverting 

input of a first op-amp 40 and, respectively, a corresponding electromyogram 
sensor 21 and a positive 5 V source. The output of this first op-amp 40 
connects to a feedback resistor 44 and through a coupling resistor 45 to the 
inverting input of a second op-amp 41 . The output of the second op-amp 41 
25 connects to a feedback resistor 46 and to an output that couples to the 
processor 32 as described above. 



So configured, electromyogram signal 47 as presented at the input of the 
unit 31 can range between a negative and positive voltage limit (in this case, 
30 - 5 V and + 5 V). The first stage shifts this signal 47 up by + 5 V and scales 
the output of the first op-amp 40 by the ratio of the feedback resistor 44 for 
that op-amp 40 as divided by the input resistor 42. Presuming an input signal 
47 having the upper and lower limits previously suggested, this ratio can be, 
for example, 1/2. As a result, an input signal 47 that ranges between -5 V 
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and + 5 V will result in an output signal 48 that, while proportionately 
identical to the input signal 47, will range only between 0 V and + 5 V. The 
latter resultant range is compatible with the analog to digital conversion 
inputs of a processor 32 such as an HC1 1 . 

Additional description regarding operation regarding various embodiments 
will now be provided. 

— y ReferringMo FIG. 5, upon sensing a first electromyogram signal 12 as 
*f iq described earlier, the processor 32 can optionally detect a "click" 51 (a click 
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C being the equivalent of a left and/or right click as can be asserted, for 

iJ \ 

Q example, by aynouse or trackball controller). A click can be detected 51 by 

H \ 

£H sensing, for example, a very short duration electromyogram signal. So 

configured, a user would only flex a monitored muscle very briefly to thereby 

%U \ 

*Q 15 create an electromyogram signal that would be detected 51 as a click. Other 

jj\ schemes could be utilized as well, of course. For example, two quick 

ft! successive muscle flekings could be required, or a short first flexing followed 

q by a medium length second flexing. Many other approaches could be utilized 

p as well, and the invention, should not be viewed as being limited to any 

20 particular pattern or scheme. Upon detecting 51 an electromyogram signal 

that is to be interpreted as a\click, the processor 32 establishes 52 that a 

click has been asserted. 



Otherwise, presuming either that aa click has not been detected 51 or that no 
25 click detection has occurred, the electromyogram signal is utilized to 

establish 53 a corresponding angle ot directional movement for the display 
indicator. This information can then be\optionally used to rotate the 
corresponding screen symbol. For example, an on-screen cursor 61 may 
have a starting position and orientation as depicted in FIG. 6. Based upon 
30 the angle of directional movement as established 53 by the processor 32, 
the on-screen cursor 61 can be rotated 71\as depicted in FIG. 7. The amount 
of rotation 71 can comprise a function of the magnitude and/or duration of 
the electromyogram signal (and hence the magnitude and/or duration of the 
monitored muscle flexing). Rotation 71 of the ©n-screen cursor 61 can either 
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be done after the signal has been fully processed or during processing of the 
signal. The latteryapproach has the advantage of being more real-time and 
providing substantially immediate visual feedback to the user. The latter 
advantages can facilitate both a shortened learning cycle and a potentially 
5 speedier user interfacte in use. 

For some purposes, it may be inappropriate to rotate the on-screen cursor 
61 in itself (this can be particularly true when the on-screen cursor 61 has no 
particular directional orientation itself that will usefully suggest to the user the 
10 resultant angle of directional movement). In such a situation, it may be 
q appropriate to provide an on-screen directional indicator 81 in conjunction 

w with the on-screen cursor 61 as depicted in FIG. 8. As shown in FIG. 9, this 

01 on-screen directional indicator 81 can be rotated as described above while 

Jl leaving the on-screen cursor 61 in an unrotated state. Various on-screen 

15 directional indicators can of course be utilized and can be placed in various 
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positions with respect to the on-screen cursor. All such variations should be 
considered as being within the scope of these teachings. 

Referring now to FIG. 10, upon sensing 14 the second electromyogram 
20 signal, again, optionally, a click assertion can be detected 101 and 
established 102 when detected. If desired, a click as detected 51 in 
conjunction with the first electromyogram signal can be translated as a left 
click and a click as detected 101 in conjunction with the second 
electromyogram signal can be translated as a right click. Other combinations 
25 and permutations are of course possible. Following this optional step, the 
processor 32 produces information to move 103 the display indicator (in this 
case, the on-screen cursor). For example, and with reference to FIG. 1 1 , the 
on-screen cursor 61 can be moved 1 1 1 in accordance with the movement 
information generated 103 by the processor 32. Again, this movement 
30 information can be implemented during processing of the second 

electromyogram signal or following full receipt of the second electromyogram 
signal (and again, real-time processing offers the advantage of real-time 
visual feedback to the user). Also as before, the magnitude of movement can 
be made a function of the magnitude of the electromyogram signal, the 
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duration of the electromyogram signal, or some combination thereof. 

Other possibilities exist as well. For example, the distance of movement can 
be made a function of the duration of the electromyogram signal and the 
5 speed with which the display indicator moves can be made a function of the 
magnitude of the electromyogram signal. These and other similar 
alternatives should again be considered as being within the scope of these 
teachings. 

Referring now to FIG. 12, it should be understood and appreciated that the 
basic methodology as described above can be effected in a variety of ways. 
As described, the processor 121 receives the electromyogram signals and 
translates those signals into display indicator movement information. This 
movement information is then provided to a receiver 36 that converts the 
received movement information into an appropriate interface protocol that 
the computer 37 receives and utilizes as though it were, in fact, mouse 
movement information. 

Alternatively, the processor 121 can function to receive the electromyogram 
signals and can further function to foreword digitized versions of those 
signals to the receiver 36. The receiver 36 can then be provided with the 
electromyogram signal translation capability described above to translate the 
electromyogram signals into corresponding display indicator movement 
information that is again provided to the computer 37 in an appropriate 
compatible format. 

In yet another approach, the processor 121 can again serve to only foreword 
digitized versions of the electromyogram signals to the receiver 36 which 
then serves to provide those essentially raw signals to the computer 37. In 
30 this embodiment, the information would likely be provided to the computer 
through an RS232 port or other appropriate serial or parallel data input port. 
The computer 37 which then effect the translation processing to convert the 
electromyogram signals into the display indicator movement information. 
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It is also possible that the translation functionality could be distributed over 
two or more of these components as might be appropriate in a given context. 

And, as mentioned earlier, in all of these embodiments a wired link as versus 
a wireless link could be utilized. Depending upon the capabilities of the 
computer 37, such a wired link could obviate the need for the receiver 36 
altogether. 

Although the physical location where the translation occurs can vary 
depending upon the embodiment, all such location possibilities should be 
viewed as being within these teachings. 

By provision and practice of the above embodiments, a relatively simple, 
economical, effective, and easily learned mechanism for controlling an on- 
screen display indicator such as an on-screen cursor can be realized. Only 
two biometric sensors are required to achieve these results. Because 
virtually all at least somewhat operational muscles can be utilized to drive 
the sensors, this approach can be successfully utilized with virtually all 
potential users. Although various embodiments and specifics have been set 
forth, those skilled in the art will recognize that additional modifications, 
variations, and combinations can be readily made. Such modifications, 
variations, and combinations should be considered as being within the scope 
of the invention. 



